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Abstract 

Background: The Binge Eating Scale (BES) questionnaire is a self-adnninistered instrunnent developed to identify 
binge eaters. The aim of this study was to assess the validity of the Malay language version of BES as a screening 
instrument for binge eating. A cut-off point of 17 is taken as comparable to the Structured Clinical Interview for the 
DSM-IV patient version (SCID-I/P), the gold standard for the diagnosis of Binge Eating Disorder. 

Method: The questionnaire was structured from the English version of the original scale which has 16 items. The 
sample was obtained from outpatients and healthy adult volunteers at a teaching hospital. After completion of BES, 
the participants were interviewed with the SCID-I/P. The interviewer was blinded to the BES score. 

Results: The Malay version of BES yielded a sensitivity of 84.6%, specificity of 94.9%, a positive predictive value of 
81.8%, a negative predictive value of 95.7%. Area under the curve was 0.95 (95% confidence interval: 0.90-0.99). The 
results of factor analysis indicated a two factor structure of feelings/cognition and behavioural manifestation of 
binge eating. Internal consistency, Cronbach's alpha was 0.89. 

Conclusion: The BES performed satisfactorily as a valid instrument for screening of binge eating among 
Malay-speaking population. 
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Background 

Binge eating is currently increasing in recognition in as- 
sociation with higher body mass index (BMI), psychiatric 
symptoms, psychological disturbances, personality psy- 
chopathology and impaired quality of life [1,2]. It is a 
condition where a person recurrently has out-of-control 
eating episodes but without inappropriate compensatory 
behaviour. Binge eating disorder has been recognised as 
a diagnostic entity and included in the 4*^ edition of 
Diagnostic and Statistical Manual of Mental Disorder 
(DSM-IV-TR)[3]. A binge episode is characterised by: (1) 
eating, in a discrete period of time (e.g. within any two 
hour period), an amount of food that is definitely larger 
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than most people would eat during a similar period of 
time and under similar circumstances and (2) a sense of 
lack of control over eating during the episode (e.g. a feeling 
that one cannot stop eating or control what or how much 
one is eating) [3]. Binge eating was found in 7.5% to 30% of 
obese individuals seeking treatment [4-9] whist in commu- 
nity studies conducted in the United States, a lower preva- 
lence was found, ranging from 1.0%-4.6% [9-11]. 

Structured clinical interview is considered the gold 
standard to assess any psychological disorder including 
binge eating. However, it is time-consuming, requires 
training and can only be administered to one subject at 
any particular time [12,13]. Therefore, self- administered 
questionnaires are useful alternatives used in studies on 
binge eating. The Binge Eating Scale (BES) is a 16-item 
self-administered questionnaire, designed specifically to 
identif)^ the behavioural, emotional and cognitive charac- 
teristics of binge eating in individuals. Each item presents 
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three or four differently weighted statements. Subjects 
would select the statement that best describes their per- 
ceptions and feelings about their eating behaviour. This 
questionnaire has been proven to be useful to identify 
binge eaters, to evaluate binge eating severity and also as a 
parameter of treatment outcome [14,15]. This measure 
has been found to discriminate effectively among individ- 
uals with absent, moderate, and severe binge eating prob- 
lems. The authors of this measure reported that it yields 
internally consistent scores (Cronbachs alpha = 0.85) [14]. 
Based on BES scores, the uncontrolled eating behaviour 
are graded into three different levels of severity: subjects 
scoring 17 and less were considered non-binge eaters, 
those scoring between 18 and 26 were moderate binge 
eaters and those scoring 27 and above were considered 
severe binge eaters [15,16]. Among the different validated 
versions in the literature are the English, Portuguese, 
Italian, and Spanish versions [6,12,14,17]. 

Due to the diversity of the Malaysian population and 
the use of the Malay language as the main language, we 
believed that it was necessary to have a validated Malay 
version of the BES to allow better understanding of the 
questions asked. The Malay version of the BES was 
obtained from a previous community survey study [18]. 
To our knowledge, there has been no validation study of 
the Malay version of BES using a gold standard inter- 
view such as the SCID-I/P. The aim of this study was to 
assess the validity of the Malay version of BES against 
the SCID-I/P. 

Method 

Participants 

This was a cross sectional study carried out at a teaching 
hospital. We recruited 150 participants attending the med- 
ical outpatient clinic, medical students and staff members 
who were able to read and write in the Malay Language. 
Participants were excluded if they have serious medical 
illnesses that would affect their ability to answer the 
questionaire. Written informed consent was obtained 
from those who agreed to participate. Three ethnic 
groups were represented, the majority (76.7%) being 
Malay. The Malay Language 'Bahasa Melayu' is the 
national language for all ethnic groups to learn in school. 
It is the first language for the Malays. All our participants 
including the Chinese (17.3%) and Indians (6%) were 
fluent in the Malay Language. 

Procedure 

Prior permission to use the questionnaire was obtained 
from the authors of the original English version of BES. 
Participants were initially asked to complete the Malay 
version of the BES. Participants were then interviewed 
with the Structured Clinical Interview for DSM-IV- 
patient version (SCID-I/P) by the investigator who 



was blinded to the BES scores. The investigator was trained 
by a senior psychiatrist familiar with the SCID-I/P. The 
BES questionnaire was then scored by an assistant who was 
blinded to the SCID-I/P results. The BES was scored by 
adding the values for the 16 individual items, with a final 
score varying from 0-46. The study protocol was approved 
by our Institutional Ethics and Clinical Research Commit- 
tee (Approval number: FF-350-2012) and registered with 
the National Medical Research Registry (NMRR-12-825- 
13598). Participants received no compensation. 

Measures 

As discussed above, the BES is a questionnaire that ad- 
dresses behavioural manifestations (e.g. eating large amounts 
of food) and feelings/cognitions surrounding a binge episode 
(e.g. guilt, fear of being unable to stop eating). It con- 
sists of 16 items, eight describing the behavior mani- 
festations and eight describing feelings/cognition. Each 
question had 3 or 4 weighted statements that reflect a 
range of severity for each characteristic. Weights were 
0-3, (0 = indicates no binge eating problems, 3 = reflects 
severe binge eating problems). Participants choose the 
statement that best describes their perceptions and feel- 
ings about their eating behavior. For example, item num- 
ber six has three statements that read: (1) I don't feel any 
guilt or self-hate after I overeat (weight = 0); (2) After I 
overeat, occasionally I feel guilt or self-hate (weight =1); 
and (3) Almost all the time I experience strong guilt or 
self-hate after I overeat (weight =1). 

The BES is scored by adding the individual values for 
the 16 items with the possible range of scores from 0-46. 
A cut-off point of 17 is commonly used; a score of 18 and 
above indicates the presence of binge eating. 

The Structured Clinical Interview for the DSM-IV- 
patient version SCID I/P is a widely used clinician- 
administered interview for diagnosing psychiatric disorders 
according to DSM-IV Axis I. 

Statistical analysis 

Data were analysed using IBM SPSS version 19. Concur- 
rent validity was assessed in terms of sensitivity, specifi- 
city and predictive values. For these analyses, BES was 

Table 1 BES score at a cut-off point of 17 and 



SCID-I/P diagnosis 







SCID-I/P diagnosis 


Total 


Binge eaters Non-binge eaters 


BES score 


>17 


27 6 


33 




<17 


5 112 


117 


Total 




32 118 


150 



SCID-I/P-Structured Clinical Interview for DSM-IV. 



BES - Binge Eating Scale (Malay version). 
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Table 2 Prevalence of BED according to SCID-I/P and BES 

% 95% Confidence intervals 



Sensitivity 84.6 

Specificity 94.9 

Positive predictive value 81.8 

Negative predictive value 95.7 
Prevalence 21 

Accuracy 92.6 

Precision 81.8 



68.2- 93.1 

89.3- 97.6 
65.6-91.4 

90.4- 98.2 
15.2-28.9 



SCID-I/P Structured Clinical Interview for DSM-IV. 
BES- Binge Eating Scale (Malay Version). 

compared to SCID-I/P, considered in this study the gold 
standard for diagnosis of BED. The Receiver Operator 
Characteristic curve (ROC curve) was used to describe 
the instruments performance. Construct validity was 
assessed using factor analysis. The internal consistency 
was evaluated by Cronbachs alpha coefficient for the 
total score and score for each item. 

Results 

Participants 

The study included 150 participants: 47 (31.3%) males, 
and 103 (68.7%) females, with age range from 18 years 
to 68 years (mean = 31 ± 0.898). There were 115 (76.7%) 
Malays, 20 (17.3%) Chinese and 9 (6%) Indians. A majority 
were from the middle income group (89.8%) and com- 
pleted tertiary education (75.5%). 

Concurrent validity 

Table 1 shows the frequencies of the diagnosis of binge 
eating according to SCID-I/P and Malay version of the 



BES. The cut-off point of 17 is used; a score of 18 and 
above indicates the presence of binge eating. The sum- 
mary of the concurrent validity results are presented in 
Table 2. The relationship between sensitivity and specifi- 
city is represented by the ROC curve. The area under 
the curve is 0.95 (95% CI: 0.90-0.99) (see Figure 1). 

Factor analysis 

Before performing factor analysis, the feasibility of par- 
ameter estimates and adequacy of measurement model 
were examined. Inspection of the correlation matrix re- 
vealed the presence of many coefficients of 0.3 and above. 
The Kaiser-Meyer-Olkin value was 0.89, more than the 
recommended value of 0.6 and Bartlett s test of Sphericity 
was statistically significant, supporting the factorability 
of the correlation matrix. The two-factor structure was 
best fit to the data (see Figure 2). It explained a total of 
47.2% of the variance, with factor 1 contributing 39.06% 
and factor 2 contributing 8.15%. Varimax rotation with 
two-factor solution was performed, reveaUng the pres- 
ence of simple structure with both factors showing a 
number of strong loading as presented in Table 3. The 
factors were clearly feelings/cognitions related to binge 
eating (factor 1 items 1, 2, 6, 9, 11, 12, 14, and 16) and 
behavioural manifestations of binge eating (factor 2 items 
3, 4, 5, 7, 8, 10, 13, and 15). 

Internal consistency 

The overall internal consistency of the Malay version of 
the BES, measured by Cronbachs alpha coefficient yielded 
0.89. The corrected item-total correlation values for each 
item were more than 0.3 indicating that each item corre- 
lates well with the total score. The Cronbachs Alpha for 



ROC Curve 



0.8- 



0.4- 




O.O-' \^ 1 1 1 1 1 ' 
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Figure 1 ROC curve showing the accuracy of BES as a screening test for binge eating behaviour. Area under curve = 0.95; 95% CI 
0.90-0.99, S.E (area) = 0.021. 
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Figure 2 Scree Plot showing two components with eigenvalue more than 1. 
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Table 3 Results of factor analyses: varlmax rotated 
factor loadings 



BES items Factors 





1 


2 


Item 12 


.778 




Item 6 


.738 




Item 1 


.670 




Item 14 


.643 




Item 2 


.604 


.330 


Item 9 


.564 


.363 


Item 1 1 


.559 


.311 


Item 8 




.484 


Item 7 




.458 


Item 16 


.518 


.351 


Item 3 




.684 


Item 15 


.390 


.608 


Item 4 




.602 


Item 13 




.594 


Item 5 


.370 


.545 


Item 10 


.429 


.465 



Note: Bolded items indicate major loadings for each item. 



each item range from 0.874-0.891 (see Table 4). Mean of 
inter- item correlation was 0.337 with variance of 0.014. 

Discussion 

Over the last decade, there has been a marked escalation 
of incidence of overweight and obesity worldwide. The 
World Health Organisation estimates that in 2008, 35% 
of adults and overweight and 11% are obese [19]. A na- 
tional survey in 2006 has revealed a high prevalence of 
overweight and obesity of 44% among the adult popula- 
tion in Malaysia [20]. Binge eating is a recognised asso- 
ciation with overweight and obesity, with a rate of 19% 
among healthy sedentary staff of a government institu- 
tion [18] and 10.8% among patients attending a dietician 
clinic [21]. This emphasises the importance of identify- 
ing this particular eating habit among our population. 
Our choice of BES was based on the simple scoring sys- 
tem and its widespread use as a screening tool in vari- 
ous studies in the literature. 

To the best of our knowledge, this current study is the 
first to compare the Malay version of BES with the 
standard SCID-I/P. The results showed that the Malay 
version of BES is a good tool to discriminate between 
binge eaters and non-binge eaters in our population with 
an AUG = 0.95 (95% CI: 0.90-0.99). It also showed high 
level of sensitivity in identifying individuals with binge 
eating behaviour (84.6%) and considerable specificity in 
identifying individuals without binge eating behaviour 
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Table 4 Results of reliability analysis, using Cronbach's alpha 



Item-total correlation Cronbach's alpha if item deleted 



Item 1 


.446 


.884 


Item 2 


.619 


.877 


Item 3 


.534 


.881 


Item 4 


.326 


.887 


Item 5 


.563 


.880 


Item 6 


.576 


.879 


Item 7 


.633 


.878 


Item 8 


.678 


.874 


Item 9 


.601 


.878 


Item 10 


.560 


.880 


Item 1 1 


.555 


.880 


Item 12 


.505 


.882 


Item 13 


.291 


.891 


Item 14 


.687 


.875 


Item 15 


.619 


.878 


Item 16 


.554 


.880 



(94.9%). The findings of this study were fairly consistent 
with the vaUdation study that used the Italian language 
version of BES, which was conducted among patients 
attending an outpatient clinic, yielding a sensitivity of 
84.8%, and specificity of 74.6% [6]. However, a study that 
utilised the Portuguese language version [12] reported a 
higher sensitivity (97.8%) but lower specificity (47.7%) 
compared to ours and the Italian version. One reason for 
this variation could be the different recruitment strategies 
employed. The study that utilised the Portuguese version 
recruited participants through a newspaper advertisement 
to a eating disorder reference centre. Similarly, a higher 
sensitivity (94%) and lower specificity (76%) was also found 
in a recent study using the BES to screen patients seeking 
bariatric surgery in the United States of America [20]. 

Other studies that examines the validity of BES showed 
BES as a useful screening tool in identifying individuals 
with binge eating behaviour as well as being accurate in 
identif)^ing individuals without binge eating behaviour. 
Two studies in the literature that compared BES with 
Eating Disorder Examination (EDE), another clinician 
directed interview showed that BES is an appropriate 
measure although with false positives being common. 
We did not use EDE in this study as it is too lengthy, 
taking as long as 60 minutes and we deemed this not 
practicable in an outpatient setting. The first study yielded 
sensitivity and specificity of 85% and 20% respectively [22] 
and second study yielded 93% and 49% [23]. Both studies 
had sensitivity comparable with ours but lower specificity 
which may be due to false positives. Screening instru- 
ments however, tend to tolerate a greater false positive 
rate. Accepting some false positives and then ruUng out 



a true case in a complete interview is preferred rather 
than missing true cases completely as a result of a false 
negative screen. 

The use of factor analysis helped to evaluate the fac- 
torial structure of the Malay version. Consistent with the 
literature, there were two main factors obtained which 
measures feelings/cognition and behavioural manifesta- 
tions [24]. 

Internal consistency, a quantitative measurement using 
Cronbach alpha coefficient is to assess the consistency 
of results across the items within a test. The internal 
consistency reliability study of the Malay version of BES 
showed a value of Cronbachs alpha of 0.89. Alpha coeffi- 
cient ranges in value from 0 to 1 where the higher score 
indicates a more reliable scale. A value above 0.7 is indi- 
cated to be an acceptable reliability coefficient and thus 
our value of 0.89 fulfils this criterion [25]. This value 
is also consistent with the original BES which had a 
Cronbachs alpha = 0.85 [14] and the Portuguese version, 
Cronbachs alpha = 0.89 [12]. This demonstrates that the 
Malay version of the BES is a reliable screening tool for 
the Malay-speaking population. 

This study has limitations. Although there was a good 
sample size, there was a low percentage of males and 
small representation from the lower socioeconomic group. 
This may limit the generalizability of these findings. 

Conclusion 

This study demonstrated high levels of sensitivity (84.6%) 
and specificity (94.9%) of the Malay version of BES in 
detecting binge eating behaviour within a Malay-speaking 
adult population, with a positive predictive value of 81.8%, 
negative predictive value of 95.7% and Cronbachs alpha 
of 0.89. In light of the increasing prevalence of overweight 
and obesity, binge eating may very well be an important 
factor. Therefore, the Malay version of the BES is useful as 
it has been demonstrated to be a valid and reliable instru- 
ment that is easy to administer. 

Competing interests 

The authors declare that they have r^o competir^g ir^terests. 
Authors' contributions 

SAR, TM, RAG, NAK, ar^d SAS contributed to the study desigr^, and data 
collection. SAR and SAS performed the statistical analyses, while RSA, TM, 
RAG, NAK, SZ participated in drafting and editing the manuscript. All authors 
read and approved the final manuscript. 

Aclcnowledgments 

The authors wish to thank the Dean and Director of the Universiti 
Kebangsaan Malaysia Medical Centre (UKMMC) for the permission to publish 
these data. We are also grateful to the staffs of the Endocrine Unit for their 
assistance in data acquisition. We would like to thank Elsevier for permission 
to use the English version of the BES questionnaire in this study, and Dr 
Anilah Abdul Rahim for providing the Malay version of the questionnaire. 

Author details 

^Endocrine Unit, Department of Medicine, Universiti Kebangsaan Malaysia 
Medical Centre Jalan Yaacob Latif, Bandar Tun Razak, Cheras 56 000 Kuala 



Robert et al. Journal of Eating Disorders 2013, 1:28 
http://www.jeatdisord.conn/content/1 /I /28 



Page 6 of 6 



Lumpur, Malaysia. ^Department of Psychiatry, Universiti Kebangsaan 
Malaysia Medical Centre Jalan Yaacob Latif, Bandar Tun Razak, Cheras 56 
000 Kuala Lumpur, Malaysia. ^Department of Community Health, Universiti 
Kebangsaan Malaysia Medical Centre. Jalan Yaacob Latif, Bandar Tun Razak, 
Cheras 56 000 Kuala Lumpur, Malaysia. 

Received: 20 February 2013 Accepted: 3 June 2013 
Published: 9 August 2013 



References 

1. Picot AK, Lilenfeld LRR: The Relationship Among Binge Severity, 
Personality Psychopathology and Body Mass Index. Int J Eat Disord 2003, 

34:98-107. 

2. Kolotkin RL, Westman EC, Ostbye T Crosby RD, Eisenson HJ, Sinks M: Does 
Binge Eating Disorder Impact Weight-Related Quality of Life. Obes Res 

2004, 12(6):999-1005. 

3. American Psychiatric Association: Diagnostic and Statistical Manual of Mental 
Disorders, 4^^ edition (text revision). Washington, DC: American Psychiatric 
Association; 2000. 

4. Brody ML, Walsh BT, Devlin MJ: Binge Eating disordenReliability and 
validity of a new diagnostic category. J Consult Clin Psychol 1 994, 62:381 -386. 

5. Yanovski SZ: Binge Eating DisordenCurrent Knowledge and Future 
Directions. Obes Res 1993, 1:306-324. 

6. Ricca V, Mannucci E, Moretti S, Bernardo MD, Zucchi T Cabras PL, Rotella CM: 
Screening for binge eating disorder in obese outpatients. Comprehesive 
Psycto/y 2000, 41:1 11 -11 5. 

7. Spitzer RL, Devlin M, Walsh BT, Hasin D, Wing R, Marcus M: Binge eating 
disorder: A multisite field trial of the diagnostic criteria. Int J Eat Disord 

1992, IKSuppI 3):191-203. 

8. Spitzer RL, Yanovski S, Wadden T, Wing R, Marcus M, Stunkard A: Binge 
eating disorder: Its further validation in a multisite study. Int J Eat Disord 

1993, 13(Suppl 2):137-153. 

9. Grucza RA, Przybeck TR, Cloninger CR: Prevalence and Correlates of Binge 
Eating Disorder in a Community Sample. Compr Psychiatry 2007, 
48(Suppl 2):124-131. 

10. Bruce B, Formally RD, Agras WS: Binge eating in females: A population- 
based investigation. Int J Eat Disord 1 992, 1 2:365-373. 

11. Stunkard A, Berkowitz R, Tanrikut C, Reiss E, Young L: D-fenflufamine 
treatment of binge eating disorder. Am J Psychiatry 1996, 153:1455-1459. 

12. Freitas SR, Lopes CS, Appolinario JC, Coutinho W: The assessment of binge 
eating disorder in obese women: A comparison of the binge eating scale 
with the structured clinical interview for the DSM-IV. Eating Behaviours 
2006, 7:282-289. 

13. Welch E, Birgegard A, Parling T, Ghaderi A: Eating disorder examination 
questionnaire and clinical impairment assessment questionnaire: 
General population and clinical norms for young adult women in 
Sweden. Behav Res Ther 201 1 , 49:85-91 . 

14. Gormally J, Black S, Daston S, Rardin D: The Assessment of Binge Eating 
Severity Among Obese Persons. Addict Behav 1 982, 7:47-55. 

15. Marcus MD, Wing RR, Hopkins J: Obese binge eaters: Affect, cognition and 
response to behavioral weight control. J Consult Clin Psychol 1 988, 3:433-439. 

16. Timmerman GM: Binge Eating Scale: Further Assessment of Validity and 
Reliability. Journal of Applied Biobehavioural Research 1999, 4(1):1-12. 

17. Partida OZ, Garcia RR, Cardenas AR: Evaluation of the binge eating scale in 
Mexican population: translation and psychometric properties of the 
Spanish version. Psiquiatria 2006, 22:30-6. 

18. Anilah AR, Rohana AG, Norasyikin AW, Badrulnizam LB, Suehazlyn Z, Noorlita A, 
Norhaliza A, Wong M, Norlaila M, NisakBarakhatun, Rizal AM, Nor Azmi K: 
Prevalence of binge eating and obesity among civil servants of the 
Ministry of Health Putrajaya. In Proceedings 14**^ Congress of the ASEAN 
Federation of Endocrine Societies (AFES). Challenges of Endocrinology in Asia 



19. 



20. 



World Health Organization: Overweight and Obesity Factsheet no 311. Geneva 
(Switzerland); 2008. http://vvww.who.int/mediacentre/factsheets/fs31 1/en. 
Institute for Public Health (IPH) 2008: The Third National Healthy and 
Morbidity Survey (NHMS III), Volume 2. Malaysia: Ministry of Health; 2006. 
Loo TH, Maniam T, Ainshah 0: Psychiatric Morbidity, Personality Profile 
and Saliva Cortisol Levels in Overweight and Obese Patients Referred to 
Dietician Clinics in UKMMC. Malaysian Journal of Psychiatry E-Journal 201 1, 
20:1. 



22. Fitzpatrick SL, Corsica JA, Azarbad L, Hall BJ, Grupski AE, Hood MM: 
Examining the Binge Eating Scale in Screening for Binge Eating Disorder 
in Bariatric Surgery Candidates. The Journal of Metabolic Surgery and Allied 
Care Clinical Research 2012. Published online 28 October 2012. 

23. Celio AA, Wilfley DE, Crow SJ: A comparison of the binge eating scale, 
questionnaire for eating and weight patterns-revised, and eating 
disorder examindation questionnaire with instructions with the eating 
disorder examination in the assessment of binge eating disorder and its 
symptoms. Int Eat Disord 2004, 36:434-44. 

24. Hood MM, Grupski AE, Hall BJ, Ivan I, Corsica J: Factor structure and 
predictive utility of the Binge Eating Scale in bariatric surgery 
candidates. Surg Obes Relat Dis 2012. Published online 14 July 2012. 

25. Santos JR: Cronbach's Alpha: A tool for Assessing the Reliability of Scales. 
J Ext 1999, 37(2):1-5. 



doi:1 0.1 1 86/2050-2974-1-28 

Cite this article as: Robert et al.: The validation of the malay version of 
binge eating scale: a comparison with the structured clinical interview 
for the DSM-IV. Journal of Eating Disorders 2013 1:28. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at 
www.biomedcentral.com/submit 



o 



BioMed Central 



